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Virtual simulator method and system for neuromuscular training and 
certification via a communication networic 

Abstract 

5 

A virtual simulator method and system via a communication network with possible physics 
law respect is used to create a virtual skill training environment for dexterity fulfillment of 
physical activities such as profiessional work, labour or craft acBvlties, sport or even 
physical rehabilitatton requirements where the skills or neuromuscular ability is required to 

10 be perfonned in a precise environment. Ail information required insuring a code of conduct, 
state-of-the-art, physic laws, technical code and technique for physical activities tn^ining 
certification for a member are managed and maintelned In a datebase by an online 
processor. This database Is maintained for continuous neuromuscular training 
improvement updates. Access to a third party witness in this training program is allowed to 

IS ensure code, law and state-of-the-art Integrity when certification is required. 
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Field of the invention 

20 The field of the invention is related to professional work, labour or craft activities, sport or 
even ph^ical rehabilttatlon requirements where the skills, dexterity or neuromuscular 
ability is required to performed physical activities In a precise environment writh electronic 
tutoring systems and methods, and more particularly, to an interactive computer-based 
training system and method operable over an Internet Protocol (IP)-t>ased public computer 

25 network such as the Internet, a corporate Intranet, and the like. This precise environment 
can be located In a online database for code of conduct, state-of-the-art. physic iavus or 
technical code for physical activities requiring training and certification. 
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Background-of the present invention 

30 Training method or devices liave long been known and widely used, if the training is 
related to a physical activity where human skills are the main purpose of the simulator, 
there is a wide list of invention showing methods and devices reproducing this activity. But 
they are all related with an hardware simulator. The term hardware simulator is commonly 
used in the trade because the vast majority of simulator requires hardware tool related to 

35 software to accurately help any user to perfomi their physical activities requires an object 
to complete simulate task . Typical simulators of this type are shown, for example, in the 
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Though such simulators have achieved considerable popularity and possibly commercial 
success, there has t^een a continuing need for improvement The present invention does 
40 not need any particular hardware simulator to reproduce the training environment. Its 
interest reside in the software control and management of neuromuscular data collected 
over image collection simulating environment where the sidii or dexterity Is a major interest 
to accomplish a minimum requirement by code, rule of the art or any physical function 
requiring minimum requirements related to neuromusoilar activities. 



45 
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Objectives of the present invention 

By practicing online virtual certification in the Internet and the World Wide Web, it has 
become obvious that a technological gap exist between traditional certification and online 
SO certification. This gap is related to the fact that there is no available technology in the 
internet Protocol (IP)-based public computer nelworic such as the Internet, corporate 
Intranet or the like for the physical and cerebral training to accomplish a minimum dexterity 
required by code, rule of the art or any physical function requiring minimum requirements 
related to neuromuscular activities. 

55 

For example, an online 2D, 3D, near 3D visual multimedia signal and auditory signal can 
areata an environment that could easily simulate visual inspection, non-destructive 
examination or destructive examination to ensure neuromuscular workmanship or 
craftsmanship requirements or skill training dexterity. Instead of learning by traditional 
60 manual approach a simulator method develop all the minimum requirements needed In 
profession, industry, field, sport or rehabilitation activities. 

Objectives to implement virtual simulator method and system are also to help the trainee to 
learn a technique and not to cope with difficult environment. For example, In a traditional 
welding training center the welder trainee has first to compose with the difficult environment 
65 of the welding electric arc (eyes protection and gaseous emanations and other complex 
technical considerations). Also in a typical traditional approach, a trainee can easily spare a 
very considerable amount of money before handling very expensive material and 
technology. 
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Summary of the invention 

70 

The present invention relates to a virtuai Emulator method and system for neuromuscular 
training and certification of profession, trade* craft, sport or rehabilitation activities via a 
communication networlc and more particuiarly to an online muttifiinctional virtuai training 
platform which implements certain predefined certification neuromuscular standards. Such 
75 metiiod and system, which can be viewed as a service, are particularly useful for 

enhancing communication and exdianges between trainer and trainee seel<ing training 
with third party witnessing services for certification purposes. 

Any physical activities that require a minimal dexterity requirement can benefit from this 
invention. For example it is common knowledge that neuromuscular skills (by opposition of 
80 neurocerebral skills) are essential for basic requirement of specialized physical activities for 
a professional work, labour or craft activities, sport or even physical rehabilitation. 

Neuromuscular virtual online training or certification can be simulated, for example, for 
speed control, acceleration, strength, precision or any neuromuscular abilities related to a 
direct relation with physical action and neurological responses. 

85 For example, skill ability for a profession, trade, craft or sport example could be welding. 
The welding ability to perfonm a sound weld according to code requirement is of a particular 
interest since it could involve safety, liability and fife duration of assembled material. In the 
field of welding, many scientific relations between welding variables are known by experts 
but no relation between welder dexterity and state-of-the-art equations have been 

90 documented yet.. This approach will then minimize physical test cost. These costs could 
increase easily when the test material is technological (welding station, welding 
consumables and metal plates and specialist's time). One prototype of such a Web site is 
under confidential research and development in the online virtual certification site of 
WWW.EDUWELDING.COM, for the assignee of tiie present application. This site provides 

95 an example of one possible implementation of this invention. The site will have ttie 

potential to be used as an online training tool by school, association, certification bureau, 
consumable or equipment supplier, plant or shop. Such organisms can access updated 
information about the trainee member status and related information about all the steps 
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involved in the training and certification of this welding process trainee. The member can 
100 disclose some of this information to a third party in the course of their technical or business 
relationship with that member. This Web site contains a welding virtual simulator method 
and system able to demonstrate to a trainer or a third party the ability of a trainee. This 
virtual simulator method and system will also be able to help the trainer to isolate the 
specialized neuromuscular skills that the trainee has to pracUoe to insure himself of good 
lOS results when a demonstration of his skills will be required. 

With the help of physic laws equation such as dynamic, mechanic of fluid and 
thermodynamic, the dexterity of the welder will flien be demonstrate by an online virtual 
simulator method and system to a trainer, immediate superior or certification representative 
1 10 for learning curve demonstration or for code minimum requirements. Prior to a physical test 
or to an online tfiird party witnessing operation, a database configuration wiOi the processor 
will have to be performed to ensure sound weld, weld size, maximum root penetration with 
metal transfer mode used in conjunction will the welding parameter settings. 

This virtual simulator method and system can enable any weld assembly and will fulfill all 
1 IS criteria of a welder test such as defined by a welding code by simply activating a computer 
screen signal by the multimedia device. A good example of tills online neuromuscular 
virtual simulator method and system applied in the field of welding will be a traditional T 
joint assembly of a weld assembly (fig. 12) to Insure efficient weld penetration and weld 
size achievement witiiout other code defect such as porosity, cracks or undercut. Code 
120 compliance and trainee, trainer and/ or thinJ party witnessing expert will received 

information from tiie virtual simulator metiiod and system according to authorized request. 

This above example of neuromuscular twining for welder is descrit)ed hereafter with the 
help of drawing sequences Fig 4 and 5. 

it also serves to structure steps and processes implemented by companies for quality, cost 
125 and delay controls and other purposes. This leads to more efficient dissemination of 

information about the qualifications and competencies of persons being certified with the 
present invention. It therefore leads to a wider recognition of trainees for companies and 
other organizations using ttie invention. 
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In a preferred embodiment, the manual dexterity virtual simulator method and system with 
130 the third party witnessing method will Involve the use of a system as described in Can. Pat. 
No. 2,31 1,685 issued to Choquet. Such a manual training is advantageous in that it permits 
a controlled input of essential variables to required tasks with third party witnessing 
certification. 
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Brief description of the drawings 

135 

The objects and features of the present invention will become more apparent in conjunction 
with the accompanying drawings: 

Figure 1 is a block diagram showing a simulator system according to the present invention. 
Figure 2 is a schematic diagram illustrating a manual dexterity virtual simulator method and 
140 system. 

Figure 3 is a schematic diagram illustrating a system according to the present invention. 
Rgure 4 is a flowchart showing a general process followed by the system according to the | 
present Invention. 

Figure 5 is a flowchart showing a database consulting process followed by the system 
145 according to the present invention. 

Rgure 6 is a flowchart showing an operation flow of the certification method for a welding 

scenario, an operation flow of accepting or registering a new member site and a layout 

example of the authentication datat)ase, according to the present invention. 

Figure 7 is a flowchart showing an operation flow of certification steps & interface display 
150 for the welding scenario, according to the present invention. 

Figure 8 is a diagram showing an example of a welding card holder according to the 

present invention. 

Rgure 9 is a diagram showing an example of an online welding certification checklist, 
according to the present invention. 
155 Rgure 10 Is a diagram showing an example of a list of esserttial variables for welding 
certification, according to the present invention. 

Rg. 11 Is a multimedia shooting view of a PDS and it can be identified as Virtual Dexterity 
Simulator (VDS). 
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Description of tlie preferred embodiements 

160 

Training scenarios are retrieve from tlie infomiation system database figure 1, item 2 and 
then praoessed by the neuromuscular simulator processor figure 1 , item 1 to the trainee 
level required. The data storage will be Icept in virtual database figure 1. item 3. Detailed 
open training database center site is described in figure 3 item 36. 

165 

A description will now be given. In detail, of an embodiment in accordance with the present 
Invention. The present Invention Is not restricted by this embodiment. 

Figure 4 describe a welding scenario flowchart showing a general training process followed 
170 by the system according to the present invention. The retrieved welding scenario (ffgure 4 . 
item 43) is processed online to ensure code and trainee accurate revision status. Welding 
training scenarios are multimedia information. Specific information about the Input of 
welding training scenarios is shown in figure 10 and 1 1 . 

175 The figure 4, item 44 loop is responsible to verify the welding configuration validation with 
code requirement and state-of-the-art physical activities. Welding configuration, code 
requirements are described in detailed for the training / certification In the sequenced figure 
11 to 22. 

180 Figure 10 to 22 describe the virtual simulator method and system method interface 

according to a preferred embodiment related to welding training. The system has client 
stations connected to a server station. As shown in figure 2, each worl^ station may 
comprise a computer, a monitor, an input device (e.g. a mouse and a Iceyboard), etc. The 
client station may be used for different purposes, according to the access rights allocated 

185 to the user. For example, a trainee will have rights, for performing various tests but will of 
course have no rights to change some data like his/her test results, his/her skill level. Such 
rights will possibly be granted to the trainer. Other rights will be granted to the certifying 
third party. 
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190 Welding data sheets such as figure 1 0 help welding trainee to set-up their work 

environment to perform optimize weld results. For example this welding data sheet will be 
used to configure the online virtual simulator system (figure 11). 

Referring to Figure 1 1 , the simulator has an interface for interaction with the trainee. The 
19S interface can be conveniently provided by the monitor of the computer used by the trainee. 

Item 1Q2 of Figure 10 is an example of weld transverse cut. These cuts vary according to 
the weld preparation. Item 101 is showing a double U groove weld preparation. Different 
shapes can be simulated by this Process Data Sheet (PDS). A list of simulation shapes 
200 possibilities can be identified in reference named "ANSI/AWS D2.4-98, Standard Symbols 
for Welding, Brazing, and Non-destructive Examination" This PDS is an equivalent of a 
frame taken out of a animation movie such as multimedia video In other words this PDS 
image is an animation picture extract shot representation of a weld transversal cut with the 
list of essentials variables that defined It. 

205 

The Interface has a first window section (items 105 to 128) In which the elements used in 
the test are displayed. Another window section (items 129 to 134) displays test parameters 
and controls for interactively adjusting them if necessary. The simulator generates these 
elemente based on preset date retrieved from the figure 3 item 36 datebase. The 
210 neuromuscular processor simulator does the required calculation on time and online in 

response to the starting procedure set in motion by the trainee with an input device (e.g. a 
mouse) and produces an image (items 135 to 138) that replicates a weld bead according to 
the welding parameters management by the trainee. 

215 For example, two part of metal (items 135 and 136) are assembled in a proper position and 
essentials variables (items 105 to 134) are settled in a proper manner to produce sound 
welds according to code criteria. When these essential variables are used in conjunction 
with a multimedia device that will allow a computer screen to receive signal (item 137) a 
virtual image of a weld (item 138) Is obteined. This Image can be processed to certHy code 

220 and rule-of-the-art compliance. An unlimited application possibiiify of this method can be 
developed for any neuromuscular activities. 
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The objective of the trainee le to obtain a sound weld with a good management of his 
welding parameters. Sound weld are defined in welding code or handbook. An example of 
225 a good weld can be visualized in macrographic cut (figure 12). This result can only be 
viewed after destructive test and cannot be monitored during welding with conventional 
welding technolc^y. 

The figure 13 shows that the essential variables of the simulator system are adequately 



230 configured with the mouse cursor help ^ that is set in motion by an input device such as 
a computer mouse. For example, the present figure 13 case iiiustrates a simulation of the 
figure 12. This case is the welding set-up of 2 6"X6'*X 3/8" aiioy 6061 -T6 aluminum plates 
aluminum with 0.045" diameter filler aluminum alloy 4043 in the horizontal position. The 
generally recognized dimensional code requirement size of the weld is minimum 6mm 
23S (1/4") with a convexity of 1/8" (3 mm) maximum and a minimal penetration of 2 mm. 



Therefore with his mouse cursor ^ , the trainee adjusts his cunrent source to a wire speed 
adjustment Just nice in real situation. Currently his cunent source is activated fbr 250 amps. 

The trainee test acceptance criteria will be in accordance virith the generally recognized 
240 code requirements. 

When the trainee oonsiders that his test set-up is adequate, he must affix the mouse cursor 
at the starting point of his assembly (see figure 14). As soon as he dicics on his input 
device in this case his computer mouse, the neuromuscular simulator processor is started 
24S and activates a time calculation required for result output. The trainee then must move his 
computer mouse on the plates to Join contact axis to demonstrate a sound weld. Speed is 
one of the important <^teria but the stralghtness of tlie computer mouse is also. This 
precision is in the millimeter range. 

As soon as the trainee elides on his computer mouse an instrucQon is given to the 
250 neuromuscular simulator processor to calculate a material deposition rate which coincides 
with an image simulating the real aluminum weld deposition. For example, this processor 
calculates the liquid stete aluminum flow rate as long as the welder trainee will not have 
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retease his input device trigger wiiich in this particular case is its computer mouse. If the 
trainee operates in a variable bracket combination which allows him to deliver a welded 
255 zone according to the training requirements then the result will be a sound weld and 
considered without defect. If he does not operate according to the ideal training 
requirements or according to the rules of the art or the codes foreseen for that purpose, 
this deposited metal mass in the operating zone will have the consequence to create 
defects which will be visible (Figure 15). 

260 The Figure 1 5 shows a start-and*stop half-distance which is known in the field of welding 
as the compulsory stop-departure in the middle of the weld of an assembly test. This stop- 
and-start zone is always a defects potential zone and the restart has to be In accordance 
with the code currently recognized in the field. The trainee handles the computer mouse 
cursor quite as he handles the welding gun trigger. He has to maintain a constant speed 

265 and aim to maintain the straightness of his path to deliver a sound weld. His 2nd start on 
the stop will be also visually inspected. Ifs because the demonstration of a stop^nd-stop is 
also a factor of success or failure during a welder test 

The figure 16 shows that during the welding when the speed is too big or small or when the 
cursor is not well positioned, error messages appear "incorrect deposition** or "Insufficient 
270 penetration These error messages are examples of the possible monitoring with the 

neuromuscular simulator. Others monitoring are possible such as "Undercuf, "Porosity" or 
Xold lap". 

When the weld is completed (ngure 17) the neuromuscular simulator processor stops the 
275 stopwatch and allows then to compare the speed with the real case which is required 

according to the data banks which are available to this neuromuscular simulator processor. 
A trainee auto-evaluation is always possible and if he requires it a virtual non-destructive or 
destructive visual exam is then possible by the trainer or any other online third party 
required to ensure welding code requirement compliance. 

.280 

The trainee can then repeat as often as he wishes it or as often as he is allowed in the 
training environment (Figure 18 and 19). The various results obtained (fig. 18, allow the 
trainer and In the third party witnesser or the certification representative to observe a 
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detailed quality and defects retracability report obtained acoording to build-up of his training 
285 program. By experimenting several times his welding parameters, the trainee build-up a 
learning curve (Figure. 22). The trainee can re-experiment the weld deposition as often as 
he wants and a learning curve file built-up as much as he build-up results. 

The trainee will also see the visual test resulte and not visual quality (absence of defects) 
290 or defects not usually available as soon as the weld is completed. For example, the trainee 
will see his weld bead with root lack of penetration, Insufficient weld side or weld bead 
convexity not according to code. 

A learning curve is also available to the trainee, for the trainer or for the third party 
witnessing auditor If required. All or only the decision-making person will decide if the 
29S trainee Is then capable to switch to the stage of the practical tests with real welding 
equipments and consumables. 

The produced mathematical curves (Figure 21 ) allow to generate a big number of images 
or numeric signals which shall be use to improve the training program and generate also 
more complex functions such as the examples described below. 

300 • Visual exams (according to acceptance criteria code) 

• Non-destructive exams: (ultrasonic, X-rays, magnetic particle and liquki penetrant) 

• Destructive exams: (bending, tenston, fracture, macrography) 

• The complete path generated could be saved and be used on a welding 



305 • Ontime and online welding robot guidance with remotely located expert using existing 



programmable machine for a possible repetitive use 



vision system 
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FIG^ PROCESS DATA PHYSICAL ACTIVITIES INDEXER 
(WELDING TRAINING SCENARIO) 
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FIG.-4 PROCESS DATA PHYSICAL ACTIVITIES INDEXER 
(WELDING TRAINING SCENARIO) "^""^^ 
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FIG.-5 MAIN PROCESS DATABASE 
(WELDING SCENARIO) 
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FIG.-6 PROCESS & PROCESS-USER DATA VIEWER 
(WELDING SCENARIO) 
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TRAINER AND/ OR THIRD 
PARTY WITNESSING REPORT 



TRAINER AND/OR 
THIRD PARTY 
WITNESSING 
STATUS REPORT 



^ FLOWCH/\RT SHOWING AN OPERATION FLOW OF TRAINING/ 
CERTiFICATiON STEPS & INTERFACE DISPLAY FOR THE W^DINQ ^CeL^IO. 
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FIG. 9 EXAMPLE OF ONLINE WELDING CERTIFICATION CHECK LIST 
TRACEABILITY OF WELDER TEST 

SCHEDULING OF THE QUALIFICATION OF THE WELDERS 

WELDING OPERATING MACHINE WELDER AND WELDING OPERATOR QUALJEiCATION 
TEST PLANNING SHEET 



[evolution OF THE ONLINE CERTIFICATION 




91 




WELDER NAME 



BASE METAL : 



DATE 



ITEM 
NO 



OPERATION 




FILLER METAL: 



WELDER TEST REF.: 




GET THE FILLER METAL ACCORDING TO THE CODE 
TEST 



PREPARATION OF THE ASSEMBLY (CHAMFERING 
/\ND TACKING) 



GET IN CONTACT WITH THE WELDING ENGINEER 

Mr'-y'n 



UPDATE 




RESP. 



AW 



AW 



DIGITAL 
PRINT 



UPDATE 



UPDATE 



m 


ACCEPTED □ REFUSED □ 


WE 


UPDATE 




^S^^ENTi)i= ^i^E R^iS^^WE"'^'^^ 






20 


RESPONSIBLE PERSON 


AW 


UPDATE 










22 


TRANSMISSION OF THE RESULTS TO THE DIFFERENT 
INTERVENING PARTIES 


AW 


UPDATE 



LABORATORY 



S^^THJS DATED OF: 02-12-19 14:01:51 
eL— .OVErWEUaiMG ENGINEER; AW: AUTHORIZED WORKER; LABO: 



COPYRIGHT © 2000. ALL RI6HtT«,97jEvEDl 
PATENT PENDING 
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FIG. 10 LIST OF ESSENTIAL VARIABLES FOR WELDING CERTIFICATION 
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SECTION . . .3.0 


WELDING 




PART .E480XT-9 CH. 


DATA 




SHEET 




PAGE - 




NO: F7-1 Bl 12 25-5 


DATE.-.june 20 2001 










HOOIE (1) : THE WELDING SPEED IS GIVEN AS A REFBRENCB OR A GOIDB BECftDSE ZT IS FONCTIO 
OP CDRRENT, VOLOJAfiE AND SIZE OF HELD REQDZSED OR DEFOSIIED. 



GO TO PARA 2.2.12 FOR ALLOWED RANGE. 
(2) : THE NOMBER OF PASSES AND UgE RS CAN BE <SIEAXBr'aND IS ADJtJS 



DEPENDING OF THE NEEDS FOR XNTERMEDIAXBS DXUENSZONS. VOIR 
FOR ALLOHBD RANGE. 



(3) : GO TO PARA 2.2,12 FOR THE ALLOWABLE RANGE IN VARIABLES 
(AMPS., VOLT, GAS}« 



(4) : GO TO PARA 2.2.12 FOR WELDING TECHNIQUE . 

(5) : THE WELDING SPEED IS AN KVEBUGB VALDE FOR ALL BASSES OF EACb's^ 

(6) : THE FILLER METAL - GAS CCHBZNAXIQN MUST BE APPROVED 
L 1 1 I I I 




FIG. 10 IS A DIAGRAM SHOWING AN EXAMPLE OF LIST OF ESSENTIALS VARIABLES FOR 
WELDING TRAINING AND CERTIFICATION. 
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BEST AVAILABLE IMAGES 

Defective images within this document are accurate representations of the original 
documents submitted by the applicant. 

Defects in the images include but are not limited to the items checked: 

□ black borders 

□ image cut off at top, bottom or sides 
□Tfaded text or drawing 

□ blurred or illegible text or drawing 

□ skewed/slanted images 

□ color or black and white photographs 

□ gray scale documents 
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□ OTHER: 
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